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Abstract. 

We consider ill-posed linear operator equations with operators acting between 
Banach spaces. For solution approximation, the methods of choice here are projection 
methods onto finite dimensional subspaces, thus extending existing results from Hilbert 
space settings. More precisely, general projection methods, the least squares method 
and the least error method are analyzed. In order to appropriately choose the 
dimension of the subspace, we consider a priori and a posteriori choices by the 
discrepancy principle and by the monotone error rule. Analytical considerations and 
numerical tests are provided for a collocation method applied to a Volterra integral 
equation in one dimension space. 
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1. Introduction 

Consider an ill-posed linear operator equation 

Au = f (1.1) 

with A G L(E, F ) mapping between nontrivial Banach spaces E and F. In practice 
only noisy data f s will be given. We assume here that the noise level S satisfying 

\\f 5 -f\\F<6 (1.2) 

is known and consider convergence of regularized solutions to an exact solution u * of 
(11.11) as 5 goes to zero. 

Regularization by projection onto finite dimensional subspaces of E and/or F has 
been studied in detail e.g., in PQEE3CEZ, H31H71I2T] in the Hilbert space setting. Here 
the dimension of the projection spaces plays the role of a regularization parameter. 
The error estimates of p m na allow for an a priori choice of this dimension, in 
pm oca m eu also an a posteriori choice of the dimension is considered. Our aim is 
to extend these results (or at least part of them) to the general Banach space setting. 
This is motivated, e.g., by the use of L p spaces with j) / 2 to recover sparse solutions 
or to model uniform or impulsive noise. Also the space 0(0) of continuous functions 
on some domain hi and its dual M. (O) are of particular interest since our setting allows 
then to analyze, e.g. collocation of integral equations as a regularization method. Note 
that some results regarding regularization by discretization in Banach spaces are known 
in a general setting (see ra and EDI) and about the quadrature formulae method (see 
Eli), the collocation method (see, e.g., EQ El El ESI) and the Galerkin method (see &)■ 
Let E n C E, Z n C F*, n G N, be finite dimensional nontrivial subspaces which 
have the role of approximating the spaces E and F*, respectively. For instance, the 
subspaces can be chosen in the following manner, as it will be emphasized later, 

Vn G N, : E n C E n+1 and (J E n = E, (1.3) 

neN 

Vn 6 N, : Z n C Z n+1 and [J Z n = F*. (1.4) 

n€ N 

The general projection method defines a finite dimensional approximation u n to w* by 
u n G E n and Wz n G Z n : (z n , Au n ) F * tF = (z n , f 5 ) F *, F . (1.5) 

As in the Hilbert space case, the least squares method 

u n G argminj || Au n - f s \\ F : u n G E n } (1.6) 

and the least error method 

u n £ argmin{||u|| E : Vz n £ Z n : {z n ,Au) F ^ F ^ (Zn,f 5 ) F £ F } 


(1.7) 
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can be recovered to some extent as special cases of (ll.5p . see Lemmas 13.2114.21 below. 

A justification of the name ’’least error” method will be provided later (see Theorem 
14.41 in SectionS]). 

In the following, P n : E E n denotes some projection. For drawing certain 
conclusions, this will sometimes be assumed to have the following properties: 

(/ - P n ) 2 = I - P n and Mu G X , A G R : || (/ - P n )(Ax)|| = |A| ||(7 - P n )(x) ||. (1.8) 

As opposed to the Hilbert space setting, P n is not necessarily linear any more. 

Remark 1.1. i) One can use the metric projection operator 

P n : E ->• E n P n (w) = argmin{\\w - w n \\ E : w n G E n }, 

in case it is single valued (as happens in strictly convex Banach spaces), but it can 
also be some differently defined projection operator, for an example see Section\6 ] below. 
Note that the metric projection P n is obviously homogeneous, idempotent and does fulfill 
(/ — P n ) 2 = / — P n , as one can see in what follows: (/ — P n ) 2 {u) = (/ — P n )(u ) if and 
only if 

u - P n (u ) - P n (u - P n (u )) = u- P n (u), 
which is equivalent to P n (u — P n (u)) — 0. Indeed, 

||u - P n (u ) - 0||ij < ||w - (P n {u) + v n )\\ E = ||w - P n (u) - v n \\ E , 
for all v n G E n , as P n (u) + v n G E n . 

ii) In general, single valued metric projections onto finite dimensional subspaces of 
a Banach space X are nonlinear, otherwise X would be linearly isometric to an inner 
product space, cfi, e.g., llS l p. 210]. 

Let Q n be the linear operator defined by 

Qn ■ F —>■ Z* Mg G F , z n G Z n : (Q n g, z n ) z *,z n = {z n , g)F*,F 
which allows to write (1 1.5 j) as 

Mu G E n and Q n Au n Qnf • 

The norm of Q n equals one since 

IIQnll = sup \\Q n g\\ z * = sup ( Q n g,z n } z *,z n 

9GFI|9||f=i geF,\\g\\ F =i,z„ez n ,\\z n \\ F *=ii 

= SUp (z n ,g)F*,F = I- 

\\g\\p = l,Zn^.Zn, 11-Sri 11 jr* —1 

Moreover, Q' n will stand for the metric projection onto the subspace AE n (or a single 
valued choice of the metric projection in case it is multivalued), whenever E n is a linear 
subspace of E, so that (11.61) can be rewritten as 

Au n = Q'J 5 . 
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In the Hilbert space setting, the least squares and the least error method can be shown 
to be special cases of the general projection method (11.5p upon appropriate choice of 
the spaces E n and Z n , respectively. This can be extended to the Banach spaces under 
certain conditions. For this purpose we will make use of duality mappings 

jr F *=d(±w-r F )=d<s> F , 

J^= d(±\\ -||£), q* = ^ T , (1-11) 

J^ E * = 9(JII • III) = 


cf., e.g., P Chapters I-II]. 

Moreover, we will make use of the Bregman distance induced by the functional 
&e = ^ || • He, which in case of single valued duality mapping J E ^ E * is defined by 



D q (u,u) = \ \\u\\ q E - \ \\u\\ q E + (J q ^ E \u),u- u) e *,e ■ 

(1.12) 

We will also use 

the symmetric Bregman distance 


D s q ym {u,u) 

= D q (u, u) + D q (u, u) = (J q ^ E \u) - J E ^ E *(u),U~ u) E *,E 

(1.13) 

and the identity 

provided that 

D q *(J^ E \u),J E ^ E \u)) = D q (u,u) 

Vu G E : J E *^ E ** (Jq^ E * (u)) = u 

(1.14) 


holds cf. [THl Lemma 2.63]. Note that in smooth and uniformly convex spaces (such 
as L p with p e (l,oo)), convergence with respect to the Bregman distance implies 
convergence with respect to the norm and vice versa, cf., e.g. [ 191 Theorem 2.60] 


D q (u*,u k ) k ^° 0 D q {u k ,u*) k ^° 0 \\u k - u*\\e 0. (1.15) 

While tools like the Bregman distance have only relatively recently been applied in 
the context of regularization, some of the fundamental concepts we use are still those 
from the seminal papers mm- In [15], which partly also works with general Banach 
spaces, error estimates for the general projection method (11.51) rely on the norms of the 
linear operator B n : F —>■ E n mapping f 5 to a solution of (11.51) . as well as the special 
projection P n : E —> E n , P n u = B n Au. Note that well-definedness of these operators 
can be shown under certain conditions, see, e.g., (12.If) . (12.2ft below. As a matter of fact, 
it is readily checked that for u n defined by (11.51) , the error estimate 

||t^* ^n\\ A (1 T 11 Pn 11) dist (w* , E^ -\- || B n || S 

holds, which splits the total error into an approximation error term and a term bounding 
the noise propagation. Error estimates of this type will enable the construction 
of convergent parameter choice rules also here and the concepts of quasi-optimality 
(uniform boundedness of ||P n ||) and robustness (uniform boundedness of HL^Ha:” 1 with 
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a n = sup Un&B M =1 ||M n ||) can be recovered in the boundedness conditions (I2.12p . 

dZ2QD, mm, raC »• 

Note that computing general projection, least squares and least error approxima¬ 
tions in general Banach spaces might not be trivial. The reader is referred e.g., to 
m Section 3], [T8] for some iterative methods (Landweber type, sequential subspace 
optimization) in uniformly convex and smooth Banach spaces. 

This work is organized as follows. Well-definedness, stability and convergence with 
a priori and a posteriori choices of the dimension parameter are shown for the general 
projection method, the least squares method and the least error method in Section 
mm and [H respectively. This theory has, of course, its limitations and can approach 
problems in various couples of smaller or larger function spaces E and F, as shortly 
outlined in Section [5j Some applications are discussed in Section |6j Namely, analytical 
considerations and numerical tests are provided for a collocation method applied to a 
Volterra integral equation in one dimension space. 


2. The general projection method 

Throughout this section, E n C E and Z n C F*, n G N, are finite dimensional subspaces. 


2.1. Well-definedness 

The following Lemma gives conditions for well-definedness of u n according to (11.51) . 
Lemma 2.1. Let 


and 


dim(E n ) = dim(Z n ) 


( 2 . 1 ) 


M(QnA) n E n = {0} (2.2) 

hold. Then (jl .5[) is uniquely solvable for any f s G F. 

Proof. Since (11.51) is a finite dimensional linear system, with (12.ip . unique solvability for 
any right hand side is equivalent to uniqueness, i.e., to the condition 

(w n G E n and Mz n G Z n : (z n , Aw n ) F * tF = 0 j w n = 0 

This is the same as (12.2[) . □ 


2.2. Stability 

For stating stability we will make use of the following quantity: 


K n := sup 


\w n \\e 


£E n ,w ,1^0 sup ZnGZn, ||z„|| F *=l(^h> Aw n ) F * 

1 


m in«;„eEn, ||u)n||B=l max z n ez n , || 2 „|| F *=l(^n, Aw n ) F * )F 

1 

max 


(2.3) 


Wn(zE n , ||u!„|| F = 1 IIQn^-UNlIz* 



















6 


Regularization by Discretization in Banach Spaces 


that is finite under conditions (12.ip . (12.2|) . In case r n defined as 

11 Aw n 11 F 


r n \= sup 


(2.4) 


Wn&En,Wn^- 0 11 Qra 11 

is finite, which, e.g., is ensured by (12.2p . one can bound k n by means of the simpler 
quantity 

II m II i-i 

(2.5) 


ft n := sup 


®n E 


max 


w„eE n w n £E n ,\\w n \\ E =l ||AuVi||e 

Lemma 2.2. Suppose that (12.ip and (12.2p hold. Then the operator A n := Q n A\E n '■ 


E n —>• Z* has an inverse and 


ftn A |^4 n || ftn A 7~nftn- 


( 2 . 6 ) 


Proof. For any w n € E n we have \\A n w n \\ F > r n 1 ||.4w n || F > r„ 1 a„ 1 ||itJ n || E . Let v n € E n 
be an element for which in (12.5p the maximum is attained. Then by (II. 10p we have 
|| A n V n || f Se 11 Av n 11 F K n ||Un||i?' I—I 

Remark 2.3. Under conditions (12. IK and (12.2K o f Lemma, 1 2. 1\ one has k n < oo, since 
one takes the supremum over the unit sphere, which is compact in the finite dimensional 
spaces under consideration. The definition of the reciprocal of the stability factor k n in 
the general projection method reveals the relation to Ladyshenskaja-Babuska-Brezzi (or 
inf-sup) conditions used for showing well-posedness of Petrov- Galerkin discretizations of 
partial differential equations. 


For the general projection method we get: 

Lemma 2.4. Let the assumptions of Lemma \2.1\ be satisfied and consider, for /i, f 2 G F 
the solutions of 


'ftn,i £ En and G Z n . ( Z n , Au n ^ij F * F fi)F*,F i 1) 2 

Then the estimate 

\\u n ,l — ^n,21| E < k n \\f\ — f 2 \\F 


holds. 

Proof. According to Lemma [2.11 the solutions u n ^,i = 1,2 are well defined. Then, the 
difference u n = u n> i — u n)2 satisfies 


u n G E n and Vz n G Z n : (z n , Au n ) F * }F = (z n , /j - / 2 )e*,e- 

Therefore, by definition of k n and u U) \ — u nj2 G E n (due to linearity of the space E n ) we 
have 


u n ,l - U n>2 \\E <ftn sup 

\^ni ^(^,1 r U J n,‘l)')F*,F 

Z n €.Zn, ||^n.|| F* —1 


=K n sup 

\Z n , fl ~ / 2 )e*,E < k n \\fi — f 2 \\ F 


Zn^Z n , H-Znll.F 1 *—1 


□ 
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Theorem 2.5. Let for all n G N, the assumptions of Lemma \2.1\ be satisfied and let u n 
be defined by the projection method (11.51) . Additionally, we assume that there exists a 
sequence of approximations («„)„g n, u n G E n , satisfying the convergence conditions 


and 


n n sup 

Z n ^Z n , H-Zn || =1 


u * — u n \\ F —y 0 as n —> oo 
(z n , A(u * — u n )') f*,f —^ 0 as n —> oo . 


(2.7) 

( 2 . 8 ) 


Then for exact data 6 = 0 we have convergence 

|| u n — u*\\e —t 0 as n —* oo . 

For noisy data and with the dimension n = n(S) chosen such that 

n(5) —> oo and k n ^)d —> 0 as S —> 0 

we have convergence 

||^n(< 5 ) — w*||i? —t 0 as S —y 0 . 


(2,9) 


Proof. For any w n G E n we have, by definition (12..'ill of k n and u n — w n G E n (here 
linearity of the space E n is used), that 

||^n 11 E — ||^* ^n||i? T ||^n ^rilli? 

< ||u* - w n \\ E + k n sup {z n ,A(u n -w n )) F * t E 

Z n CiZn , H^n Hif* —1 


^ 11^* 11 .£7 “t - ^n 


sup [{z n , A{u n - uf)) F * jF + (z n , A{u * - w n )) F * tF ^J 

.5 \\Zn ||_p* —1 

({z n , f 6 — f) F *, F + {z n , A{u * — w n )) F * iF J 
< ||w* - w n \\ E + k n (d + sup (z n , A(u* - w n )) F * >F ) 

Z n €.Z n , ll^nlliT 1 *—1 


Z n £.Z n i ||||i* 1 *—J- 

= II u* - w n \\ E + k n sup 

Zn£.Z n } \\Zn \\f* —1 


( 2 . 10 ) 

where we have also used linearity of A. Inserting w n = u n and using (12.7(1 . (12.8(1 . together 
with our assumptions on the choice of n(S) we therefore immediately get the assertions 
in both cases <5 = 0 and <5 > 0. □ 


Remark 2.6. i) The approximation property (12.711 holds, e.g., when the subspaces E n 
are chosen according to (11.311 . 

ii) Under conditions (jl .8(1 and 

||u* — P n u^\\E —* 0 as n —¥ oo, (2-11) 

on some sequence of operators {P n : E —>• E n , n G N} ? the uniform boundedness 
condition 


3 C < ooVn G N : k n sup sup (z n ,A(I — P n )w) F * tF < C (2.12) 

weE, ||io|| B =i z n ez n , |p n || F *=i 
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is sufficient for (j2.8j) and by (12.101) with w n = P n u * yields the estimate 


\u n S: (1 ~t~ C’j 11 U* -LnU*||^) “t~ ^nd • 


(2.13) 


In the context of Petrov Galerkin discretizations of PDEs, estimate (I2.10p is known 
as Strang’s First Lemma. 

2 . 4 . Convergence with a posteriori choice of n - the discrepancy principle 


Theorem 2.7. Let the assumptions of Lem,m,a \2.1\ be satisfied for all n G N and let u n 
be defined by the projection method (II,5[) . We also assume that there exists a sequence 
of approximations (u n ) ne ^, u n G E n , satisfying (12.lip and the conditions 


for 


sup 


(z n , A(u * — Urif) f*,f —> 0 as n —> 00 


Zfi £zZn , || Z-n || p* — 1 

K n+ i || (/ - Q' n )A(u* - u n ) || F -> 0 as n 00 . 
Additionally, we assume that there exists r < 00 such that 


t sup (z n ,Aw n ) F * }F >\\Aw n \\ F ,Vw n eE n , 

Zn 11 Zn H^r* — 1 


(2.14) 

(2.15) 

(2.16) 


i.e., r n < t for all n G N, where r n is defined by (12.4p . 

Denote d DP [n) = \\Au n — f s \\ F ,n G N. Let b > 1 + r be fixed and for d > 0, let 
n — n Dp(d) be the first index such that 


dop(n) < b6. 


(2.17) 


Then no P (d) is finite. 

Moreoever, u nDP (, 5 ) —* u* as d — > 0 sub sequentially in the following sense: There exists 
a convergent subsequence and the limit of every convergent subsequence solves (11.ip ; if 
u* is unique, then \\u nDP ^s) ~ w*||p —» 0 as d —* 0. 


Proof. By Lemma 12.21 and assumption (12.161) we can use K n as in (12.5p instead of k n as 
in (12.31) here. 

For any n let w n G E n be such that Q' n f 5 = Aw n . From (12.16P it follows that 


\\Au n - f 5 \\ F < || A(u n - w n )\\ F + || Aw n - f 5 \\ F 

< r sup (z n , A(u n - w n )) F * jF + || Aw n - f 5 \\ F 

Zn £zZn 1 ||^n \\f* = 1 

= T sup (z n , f s - Aw n ) F * )F + II Aw n - f s \\ F 

Zn^iZn , \\Zn \\F* = 1 

< (r + 1) dist(/' 5 , AE n ). 

In particular, since 

limsup dist (f 5 , AE n ) < d + lim sup dist(Au*, AE n ) 

n—>00 n—>00 

< d + lim sup ||A(w* — u n ) || = d, 


(2.18) 
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by (12.7j) . this implies that np>p(5) is finite. 

If for some —> 0 (k —> oo) the discrepancy principle gives n DP (5k) < N, with 
N > 0, then the sequence u nDP ^ k ) lies in a finite-dimensional subspace - the linear hull of 
E n , n = 0,..., N. Boundedness and therefore relative compactness of (u nDP (s k )) follows 
from ( 12 . 101 ) (e.g., with w n = 0 ). Since \\Au nnp ^ k ) - / 4 ||f < bS k , then Au nop ^ k ) -)• / as 
k —» oo. Hence (u nDP ^ k )) has a convergent subsequence and the limit of every convergent 
subsequence solves (II.ip . 

Otherwise, npp^d) will be larger than zero. In this case, let m = npp(S ) — 1 > 0. 
For n = m the inequality (12. 1 7j) does not hold and (12.18j) gives 

bS < || Au m - f 5 \\ F < (r + 1) dist(/ d , AE m ) < (r + 1)(<S + dist(/, AE m )). 

Since b > 1 + r we have 

—— * ^ < dist (f,AE m ) = \\Au* - Q' m Au*\\ F = ||(/ - Q' m )A(u* - u m )\\ F . (2.19) 

Inserting this into (I2.10j) with w n = u n , n = nnp(S) and using (12.6ji . (12.7p . (12.151) . 
(I2.14p . we get convergence if n DP (S ) —> oo as 5 —> 0. 

□ 

Remark 2.8. If some sequence of operators {P n : E —$■ E n , n £ N} satisfies (11.81) and 
(12. lip , then (I2.14p and (I2.15P follow from (12.71) for u n = P n u * and from the uniform 
boundedness conditions 


3 C < oo Vn gN : k„ sup sup (z n , A(I — P n )w)p* ) F < C , (2.20) 

weE, ||ui|| B =i z n ez„, |p n || F *=i 

3Ci<ooVneN :k„ + i sup ||(J - Q' n )A(I - P n )w\\ F < C\. (2.21) 

W£E, 11*16? || £7 = 1 

If additionally I — Q' n is homogeneous, one has by (12.19j) and by homogeneity of I — P n 

Km+1 ^ b 1 —— < K m+1 sup \\(I - Q' m )A(I - P m )w\\ F \\(I - Pm)u*\\ E 

t+1 weE,\\w\\ B =i (2.22) 

— Cl II (h — Pm)u*\\E- 

Hence, by (12.13p and Lemma lKR we obtain the error estimate 

H*||e 

C\t(t + 1 ) ( 2 . 23 ) 

— (1 S - ^~C) || {I Pnjjp(5)')V J * II E A || (h Pn DP (S)—l) u *\\E j 

in case npp(5) > 1. 

Note that conditions (I2.20p and (I2.2ip correspond to m = 1 in condition (1.27) of 
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Throughout this section, E n C E is a finite dimensional subspace. We show below that 
the least squares method is well-defined and converges to a solution under a priori and 
a posteriori choices for the discretization dimension. 


3.1. Well-definedness 

Lemma 3.1. Let 

Af(d)nfi n = {0}. (3.1) 

Then the set of minimizers argmin{ || Au n — / 5 ||f : u n G E n } is nonempty. If, for some 
q > 1, the functional 

<$>F-.g^\\\g\\ q F (3.2) 

is strictly convex, then the minimizer is unique. 


Proof. The finite dimensional linear subspace E n is reflexive, closed, convex and 
nonempty. The cost functional j : u n l_ t ||dw n — f s \\F is convex, weakly lower 
semicontinuous, bounded from below. It is also coercive, since the minimum nf 1 = 
min{ ||Au n ||i? : u n G E n , llfinll = 1} exists on the finite dimensional hence compact 
unit sphere and is positive by condition (13.1ft . hence boundedness of some sequence 
(||Aujj — /^IliOfceN implies boundedness of (||fik|| E ) fcgN as follows: 


\u r 


I E < SUp 

Un€E n ,Un^0 \\A-U r 


\U r 


11 Alfif 11 f ~ ||d-u(;|| F < K n (\\Au k n — / 5 ||f + II/^IIf) 


Thus we can conclude existence of a minimizer. 

Minimizing j over E n is obviously equivalent to minimizing -j q over E n . Moreover, 
strict convexity of the functional &f by (13.1ft transfers to the functional ^ j q : u n i —> 
i || Au n — f s \\ q F on E n . This implies uniqueness. □ 

In the Hilbert space setting, the least squares method can be shown to be a special 
case of the general projection method (I1.5P upon appropriate choice of the spaces E n . 

Lemma 3.2. Let (13.11) hold and let u n be defined by the least squares method (11.61) . 
Assume that, for some q > 1, the functional (13.2ft is strictly convex, the duality mappings 
satisfy 

VgeF: = g 

and J^ F * is Gateaux differentiable at ( Au n — f 5 ) with Gateaux derivative 
G n :F ^ F*, G n = (J F ^ F *)'(Au n - f 5 ). 

Then we have equivalence of (11.61) and (11.5ft by considering the linear space 
Z n — G n AE n . 
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Proof. Using the identity H/H^T 1 = \\J^ F *{f)\\F*, and the functional 

& F * ; z i —y II^IIf* 

we have that (II .6[) is eqiiivalent to 

u n E argmin {§ F *(J F ^ F * (Au n - f 5 )) : u n E E n } 

The necessary and, by convexity, also sufficient condition for this optimality problem 
reads as 

Vw n eE n : 0 = ^ ($ F *(J F ^ F *(Au n - f 5 ))) [w n ] 

= - f)) K \,d<S> F *(J^ F *(Au n - f s )) F *, F 

= ((Jq^ F *)'(Au n - f s )Au) n , J F f^ F **(J F ^ F *(Au n - f 5 )) F *, F 
= ((J^ F *)'(Au n - f s )Aw n , Au n - / V,F , 

which is (11.51) with Z n = (J F ~* F *)'(Au n — f s )AE n . □ 

Remark 3 . 3 . Since u n from the definition of the operator G n is unknown, Lemma \S.21 
is only of theoretical use. Later on, it will enable us to conclude convergence from the 
respective result for general projection methods - see Corollary Iff, hi below. For practical 
computation of u n , the finite dimensional minimization problem (11.61) should be solved. 

Note that the equality \/g E F : J F f^ F ** (J F ^ F * (g)) = g required by the previous 
lemma holds, e.g., in reflexive spaces, cf. [6j. 

3.2. Stability 

For the least squares method, the crucial quantity in the stability estimate is K n defined 
as in ( 12.51) . As in Remark 12.31 under the conditions of Lemma 13.11 we have K n < oc. 
Therewith we obtain the following stability result. 

Lemma 3 . 4 . Let all the assumptions of Lemma \3.2\ be satisfied and consider, for 
/i, f 2 £ F the solutions of 


u n ,i e argmin{\\Au n - f ,|| F : u n E E n } i = 1, 2 . 

Then the estimate 

W U n,\ — U n ,2\\E < «n \\Qnfl ~ Q'nM\F 

holds, where Q' n is some single valued selection of the metric projection onto the subspace 
AE n . If Q' n is continuous, then u n> i depends continuously on f\. 

Proof. The proof follows by the definition of K n and the fact that Au nti = Q' n fi. □ 
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Remark 3.5. The metric projection operator Q' n onto closed convex sets is single valued 
and continuous in uniformly convex Banach spaces (see, e.g., w- Thus, the above 
result is applicable to the setting F = L p with p G (1, +oo) , but not to the space C(f2) 
in general. However, since the subspaces AE n are finite dimensional according to the 
rank-nullity theorem for linear mappings, one might work with continuous selections of 
the metric operators in this nonreflexive Banach space setting if those subspaces have 
certain properties - see, e.g., Theorem 6.34 * n m- More precisely, the metric projection 
P s onto an n-dimensional subspace S ofC[a,b\ admits a unique continuous selection if 
and only if every function f G S, f 0 has at most n zeros and if every f G S has at 
most n — 1 changes of sign. 

3.3. Convergence with a priori choice of n 

Together with Lemma 13.21 Theorem 12.51 immediately implies convergence of the least 
squares method. 

Corollary 3.6. Let all the assumptions of Lemma 13.31 be satisfied. Additionally, we 
assume that there exists a sequence of approximations (m„)„ 6 n, u n G E n , satisfying 
(12.711 . (I2.8|l . where R n is defined as in (I2.3|l with Z n = (J(^ F *)'(Au n — f s )AE n . 

Then for exact data 5 = 0 we have convergence as n —» oo 

\\u n ~ u*\\e ~> 0 as n —> oo . 

For noisy data and with the dimension n = n(5) chosen according to (I2.9j) . we have 
convergence as 5 —* 0 

||w n ( 5 ) — u*\\e —> 0 as S —> 0 . 

Alternatively, we can also prove convergence directly: 

Theorem 3.7. Let condition (13. ip be satisfied for all n G N. Then an approximation 
u n according to the least squares method ('ll.61) exists and the error estimate 

\\u n -u^\\ E < inf { ||w* - w n \\ E + 2K n \\Au* - Aw n \\ F } + 2n n 5 (3.3) 

Wn€.En 

holds. If there exists a sequence of approximations (u n ) nG fq, u n G E n , satisfying (12.711 
and 

n n ||A(tt* — u n ) ||_p —> 0 as n —>■ oo, (3.4) 

then we have in case of exact data (5 = 0) convergence 

|| u n — u*\\e —^0 as n —$■ oo 

and in case of noisy data with the choice of n = n(5) according to 

n(5) —> oo and n n ^)5 —> 0 as 5 —> 0 (3.5) 

convergence as 5 —* 0: 

||w n ( 5 ) — u*\\e —> 0 as 5 —> 0 . 
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Proof. Let w n G E n be arbitrary. We have || Au n — f s \\F < ||^4u; n — f s \\F due to the 
least squares property (II.6|h therefore 


II Au n - Aw n \\p < \\Au n - f s \\ F + II Aw n - f 5 \\ F 

< 21| Aw n - f s \\ F < 2( II Aw n - f\\F + S) 


and 


tin u *\\e ^ ||u* “I - ||Un 

— ||^* ^n||i? 4” ^n ||^4^n ^4^n||.F 

< IIIt* —W n \\ E + 2 K n ( II Aw n - f\\p + 5). 


In this error estimate w n G E n is arbitrary, hence (I3.3j) holds. If some sequence of 
approximations (u n ) n£ n satisfies conditions (12.7[i and (13.41) . then insertion of w n = u n 
into (13.31) gives the convergence assertions. □ 


Remark 3.8. Note that convergence condition (13.4[) is satisfied, if some sequence of 
operators {P n : E —>• E n , nGff} satisfies conditions (jl.8j) . (12. lip and 


3 C < oo \/n G N : n n sup \\A(I — P n )w\\F < C (3.6) 

w ^ H , ||iu||_e;=1 

(compare (I2.12p . (I2.20|) ). Namely, the equality I — P n — (/ — P n ) 2 allows to estimate 
Kn\\A(I - P n )u*\\ F < C\\(I - Pn)ufi\ E . 


3.f. Convergence with a posteriori choice of n - the discrepancy principle 

Theorem 3.9. Let for all n E N condition (13.ip be satisfied so that u n according to the 
least squares method (11.61) exists. Additionally, we assume that there exists a sequence 
of approximations (u n ) n &fi, u n G E n , satisfying (12.71) and the condition 

K n (\\A(u* -u n )\\ F + \\A(u* -Un-OHir) > 0 as n y oo (3.7) 

Let b > 1 be fixed and for S > 0, let n = np>p(5) be the first index such that (12.17j) holds. 

Then for S > 0 we have that np,p(5 ) is finite. Moreover, u nDP (s) —> u* as 5 —> 0 
sub sequentially. 

Proof. The proof is the same as for the Theorem 12.71 but (I2.18P with r = 0 is now 
trivial, using optimality of u n for the minimization problem (11.61) . and hence r can be 
omitted in formula (12.191) (with m = npp(5) — 1)). Note also that we do not need now 
relations (12.6p and that estimate (13.31) with w n = u n is used instead of (12.101) . □ 

Remark 3.10. If some sequence of operators {P n : E —>• E n , n G N} satisfies (11.81) 
and (12.lip , then the uniform boundedness condition 

3C<ooVnGfd : (n n + K n+ i) sup \\A(I — P n )w\\F < C. (3.8) 

wCH, || iu ||. e =1 


is sufficient for (13.7p . 
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Throughout this section, Z n C F* is a finite dimensional subspace. We establish well- 
definedness and convergence of the least error method to a solution under a priori and 
a posteriori choices for the discretization dimension. 

4-1. Well-definedness 

Lemma 4.1. (%) Let E be a Banach space in which the unit ball is weakly compact and 
assume that 

Af(A*)nz n = {0}. (4.1) 

Then the set of minimizers argmin{ ||m||e : Vz n G Z n : (z n , Au)f*,f = {z n , 
is nonempty. 

(ii) If additionally for some q > 1, the functional 

: u i \\u\\% (4.2) 

is strictly convex, then the minimizer u n of (11.71) is unique, and so is the minimum- 
norm-solution vf of (11.11) . 

Proof. Condition (14.ip implies that the admissible set Ef d = {u G E : Wz n G Z n : 
(. z n ,Au) F *.F = (z n , / <5 )f*,f} is nonempty. To see this, we apply the Closed Range 
Theorem to the linear operator Q n A : E — y Z*, whose finite dimensional range is 
obviously closed. Hence we have the identity 

Q n AE =jV((Q n A)*) ± 

={g n G Zl I \/z n G Z n : (Q n A)*z n = 0 (g n , z n ) z *,z n = 0} 

= {dn £ Zn I ^ Z n £ Z n : A*z n = 0 =>■ (g n , Z n )z*,Z n = 0} 

=K 

under condition (14.ip . since by definition of Q n we have <5*z n = z n for all z n G Z n \ 

\/g e F : (Q* n z n , g) F *,F = {Q n g, z n )z*,z n = ( z n ,g) F *, F ■ 

Thus, the equation Q n Au = f n with f n = Q n f 5 G Z* defining Effi is always solvable 
under condition (14.11) . 

Due to our assumption on E , level sets of the cost function j :u\-± ||u||.e are weakly 
compact. Moreover, j is weakly lower semicontinuous and bounded from below. This 
implies existence of a minimizer, which in case of strict convexity of the cost function 
lj q = i s obviously unique. □ 

Also the least error method is to some extent a special case of (11.51) . However, 
different from the Hilbert space situation, the ansatz space might be nonlinear in general 
Banach spaces. 
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Lemma 4.2. Let the conditions of Lemma \f.l\ (i) be satisfied and let additionally, for 
some q > 1, the norm functional u i —> -||m|||; be Frechet differentiable, and the single 
valued duality mapping J E ^ E * be invertible. 

Then (jl .7[) and (11.51) are equivalent, when E n = ( K J E ^ fE ”)~ 1 {A* Z n ). 


Proof. By convexity and Frechet differentiability of the cost function as well as linearity 
of the constraints, optimality in (1 1. 7[) is equivalent to existence of a Lagrange multiplier 
A G R mn with m n = dim Z n such that stationarity for the Lagrange function 


L : H x R m " —»R 

m n 

(U, A) 1-)^ \\u\\ q E + ^ K(Zn,i, AU ~ f 5 ) F *, F 

i— 1 

rrin m n 

= \\\u\\e + ^i Z n,i),u) E *,E - (^2 ^ Zn ’i ’ /'V*T 

i= 1 i —1 

holds, where Z n = span{z n ^,i G {1, 2, That is, there exists A G R m ™ such that 

Jq^ E *{u n ) + A*v n = 0 and 
^^ Z n ■ {z n , Au n f )e*,F 0, 

where v n = Y^i =1 ^ i z n ,%• The first of these two equations with invertibility of J E ^ E * 
yields that (11.71) is equivalent to (j 1.5ft with E n = (J E ^ E * (A*Z n ). 

The implication (II .5^ => (11.71) can be shown also in a variational manner, by exploiting 
duality mapping properties. We include the alternative proof here, for the sake of 
completeness. Thus, assume that u n satisfies (jl.5[) with E n = ( J E ^ E *)~ 1 (A*Z n ) and let 
u be an arbitrary element of the feasible set Ejf = {u G E : Vz n G Z n : (z n , Au)f*,f = 
(z n , Then we can write u n = (J E ^' E *)~ 1 (A*v n ) for some v n and insert z n = v n 

to obtain the identity (v n , Au n )p*,F = (w, f S ) f*,f, which together with feasibility of u 
yields 

(Tq('lt rl ), U n )E*,E {.A V n , Ujf)E*,E iPm Au n ) p*,F 

— {v n , f 5 )F*,F = {v n , Au)f*,F = {A*V n ,u) f*,F < \\A*v n \\ E * \\u\\e- 
On the other hand, we have 


thus altogether 


( Jq(Un)i Mn) E*,E | A 1111F7 


l^nlls < IImIIf • 


□ 


Remark 4.3. Note that E n = (J E ^ E *) 1 (A*Z n ) is not necessarily a linear space, 
though. So in the proof of stability and convergence we cannot resort to the respective 
results on the general projection method, but have to carry out separate proofs for the 
least error method, see Lemma |^.5| and Theorem \j.b\ below. 
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In the sequel one can see that the ” least error” method deserves its name in the 
Banach space setting, too. 

Theorem 4.4. Let u * be some solution of (11.11) . Then, for any n E N, the minimizer 
u n defined by (11.71) in case f s = f attains the least error in E n = ( J^ E *)~ 1 (A*Z n ) 
measured with respect to the Bregman distance, that is, 

D(u*, u n ) < D(u*,u), Vu G E n = (jf^ E *)-\A*Z n ). 

Proof. In the case of exact data, equation (II. 5ft can be written as 

Au n AuAjF*,F 65 L n E Z n . (4.3) 

Let u E ( jy E *)~ 1 A*v with v E Z n be an arbitrary element of E n = ( jy E *)~ 1 {A* Z n ). 
Then one has 

D(u*, u n ) + D(u n ,u) - D(u*,u) = (jy E \u) - jy E *(u n ),u * - u n ) F * iF 
= ( A*v - A*v n , u* - u n ) F * tF = (v - v n , f - Au n ) F * tF = 0 , 

as v,v n E Z n satisfy (14. 3]) . Since D(u n ,u ) is nonnegative, this implies the desired 
inequality, showing that u n is the Bregman projection of -u* onto E n . □ 


4-2. Stability 

A stability result for the least error method can be formulated by using 


K n : = sup 

Zn,l,^n,2^:Zn 


||^n,l -^ngllF* 


max 

Zn,l ,Zn : 2 £Z n , |pn,l ||ir* — 1, |pn,2 |h* — 1 


D‘ F (A-z n , u A-z n , 2 ) 


(4,4) 


* *n||.F* 1 

Zn£Z n \\A*Z n \\ E * mm z n &Z n ,\\z n \\ F *=l \\A*Z n \\ E * 

Again, as in Remark 12.31 one sees that k n and k* are finite under the conditions of 
Lemma [4.11 in particular, condition (14.If) . 

Lemma 4.5. Let the assumptions of Lemma \4-2\ be satisfied and consider, for /j, / 2 gF 
the solutions of 

u n ,i e argmin{\\u\\ E : Vz n E Z n : ( z n ,Au) F * }F = (z n ,fi) F * >F } i = 1,2. 

Then the estimate 

D s q yrn (u nA ,u n y < k n \\fi - f 2 \\ F 
holds; in particular, if E is a q-convex space, then one has 
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\\u n ,l - «n, 2 \\ q E 5+1 < — max{ \\Un }1 \\ E , ||tt„,21| eY *K* n ||/l ~ j^F • 

c q 

for some constants c q , C s independent ofn. 

Proof. According to Lemma 14.11 the solutions u n ^ i = 1,2, are well defined. Lemma 
14.21 implies existence of v n i G Z n such that J E ^ E * (u n:i ) = A*v n}i , i — 1,2. Therefore, 
we get the identity 


=(^ E ‘ Kg) - J^ E * 

(A (v n ,2 Vn,l), U n ,2 

<k n (D sym (u n) 1 ,Un }2 ) 


(j^n, l),^big 

Un,l)E*,E = \V n , 2 ~ ^71,1, /2 ~ /i)f*,F 

II/2 - /i||f 


Similarly, in the g-convex and s-smooth case, which implies 


D q ym {u, u ) > D q (u, u ) > c q ||w — will; (4.5) 

II J E ^ E *{u) - J e ^ e *{u)\\ e * < C s max{ Hulls, ||«||e} 9_s ||w - m||e _1 

for some constants Cq,C s > 0 and all u,u G H (see, e.g., [31 Lemma 2.7], [IS Theorem 
2.42]), we get 

Cq ||tt„,i - tt„,2 He < L^K,!; = Kg - Vn,l, h ~ fl >F*,F 

< IKg — W,i||f* II/2 — /i||f < ||A*U n g — A*U ni i||i?» H/2 — /i||f 

< K* n c s max{ ||Mn,l||F, ||^n, 2 1|f}^ _S ||^n,l ~ Ut^Hf" 1 K ~ /i||f • 

□ 

Note that for p G (1, 00 ), L P (Q) is max{p, 2}-convex and min{p, 2}-smooth, see, 
e.g, da Example 2.47]. 


4-3. Convergence with a priori choice of n 

For the least error method, due to possible nonlinearity of the space E n according to 
Lemma 14.21 convergence cannot be directly concluded from Theorem 12.51 We obtain 
the following result with a priori discretization level choice. 

Theorem 4.6. Let E be a Banach space in which the unit ball is weakly compact 
and assume that, for some q > 1, the functional (14.211 is strictly convex and Frechet 
differentiable, and the single valued duality mapping J E ^ E * is invertible. 

Let u n be defined by the least error method (11.711 . where the operator A is assumed 
to satisfy (14.111 and 

\/z G F* : inf ||A*(z — z n )\\E* —» 0 as n —» 00 . 


(4.6) 
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Then the minimum-norm-solution td of (11.11) is unique and for exact data (6 = 0) we 
have convergence 

-D g (wt, td) — * 0 as n — y oo . 

If, additionally, the space E is smooth and uniformly convex, one has 

\\ u \ ~ u ^\\e ~> 0 as n —>■ oo 

for exact data, while for noisy data and with the dimension n = n(S) chosen such that 


we have convergence 


n(S) —> oo and k n (s)8 —>• 0 as 5 —> 0 , 
||wn(< 5 ) — u^\\e —> 0 as 5 —> 0 . 


(4.7) 


Proof. Let ul be the well defined elements (due to Lemma 14.11) 

u f n E argminj \\u\\e ■ Vz n E Z n : ( z n ,Au) F * )F = {z n ,f) F * iF }, (4.8) 


i.e., u n with exact data. Then the following holds for any solution w* to (11.ip . 


\ui 


\E < 


W* 


(4.9) 


By the assumed weak compactness of the unit ball in E, the sequence (w*) nS N has a 


weakly convergent subsequence (wJjJzeN whose limit u s 

continuous and by (z ni , Auf i — 

f) F*,F ~ 0 

for all z ni E Z , 

MzEF* : (z, Au f ni - f) F 

* >F = inf 

(z ~ z ni , 

Au l - 


= inf 

(z - z ni , 

A ( u l t 


. £ 

5 1X1 
1 
VI 

\\A\z- 

' z n t ) 11, 


ni 


Moreover, by (14.91) and weak lower semicontinuity of the norm, this limit u satisfies 
IM|e < ||m*||e for any solution -u* of (11.11) . thus it has to coincide with the 

unique minimum-norm-solution u'. A subsequence-subsequence argument yields weak 
convergence of the whole sequence to td as n —> oo. Hence, for the Bregman 

distance we get, again using (I4.9j) with -u* =u\ that 

Dq{u{,U ] ) =\\\u\\\ q E -\\W\\ q E + -U ] n ) E *,E 

<(J E ~* E * (td),td — uI)e*,e —> 0 as n —> oo 

by the already shown weak convergence. This proves the assertion in case of exact data, 
since then we have u n = u\. 
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In case of noisy data we can estimate the Bregman distance between u n and u\ by means 
of Lemma 14.51 

D s q ym (u n , K)® < k n 5. 

So by choosing n = n(5) such that n(5) —> oo and k n ^)5 —> 0 as 6 — * 0, we have 

Dqfaf, u*) — * 0 and D syrn (u n , njj« — > 0 as 5 —> 0 . 

However, the Bregman distance does not satisfy a triangle inequality, thus we need 
g-convexity of E at this point to conclude from Lemma 14.51 and (14. 5 ft 

||< — u^\\e 0 and ||u n — Klls —> 0 as 5 — > 0 , 


thus the assertion. □ 

Remark 4.7. The approximation property (14.61) is ensured, e.g., by choosing Z n 
according to (II.4j) . 


4-4- Convergence with a posteriori choice of n - the monotone error rule 


Under the conditions of Lemma 14.21 we can carry over some results for the least error 
method from the Hilbert space setting by closely following nano]. In particular we will 
show monotonicity of the error measured in the Bregman distance defined by (II. 12)1 . as 
well as convergence if the stopping index determined by the monotone error rule goes 
to infinity as S —» 0, see m Theorem 2], 


Theorem 4.8. Let the assumptions of Lemmas \4-l\ (i), (ii) and \4-S\ be satisfied. Then 
for u n defined by the least error method we have 


(a) There exists v n G Z n such that u n = (J E ^ E *) 1 (A*v n ). 

(b) With v n as in (a), the identity |K||1; = i v n, f S )F*,F holds. If Z n C Z n+ 1 for all 
n G N, then 

\\uu\\e < |K+ilU f or n eN. 


(c) With dME(n ) defined by 


dMEip) 


{v n +l - Vn, f 5 )F*,F 
Q’H'^n+l ^n||.F* 


the identities 

dME(n) 


and the estimate 


IK+lHI; IKIIe 

q IK+i - v n \\ F * 


n n ) 

|| ^n+1 Vn || p* 


Dq(u\ u n+ 1 ) - D q (u\ u n ) < -( d M E{n ) - 5) |K+i - v n \\ F * 


hold. In particular, if 


Vn G N : Z n C Z n+ i, 
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then by minimality of u n , we have cIme (n) > 0 and the error measured in the 
Bregman distance is monotonically decreasing as long as 

S < dME(n ) • (4-10) 

(d) Let n = ume (5) be the first index such that (14.101) is violated. 

U n ME^) —>■ oo as 6 —$■ 0 and (j4.6[) holds, then || u n ME (8) ~ u ^\\e —> 0 as 5 —> 0 
provided that E is smooth and q-convex. 

Proof. Item (a) has already been proven in Lemma 14.21 
Since the duality mapping satisfies 

(Jq^ E *(.w),w) E *,E= IMIe? (4- 11 ) 

we get the first part of item (b): 

11 Vn 11 E (Jq [v n ),U n ) E *,E {A V n ,U r fjE*,E 
— {V n , Au n )f*,F = (v n , f 5 )F*,F ■ 

Note that v n as in (a) satishes (v n , Au n )p*, F = {v n , f S ) f*,f and (v n , Au n+ i)p *,f = 

(v n , f 5 )F*,F, due to the assumption Z n C Z n+i . Then (11.71) yields the second part 

of (b). 

The hrst identity in (c) is an immediate consequence of (b), while the 
second one follows from (v n , Au n +\) F * ,f = {v n , Au n )F*,F which can be rewritten as 

{Jq (^n); V n +1 Vn)E*,E 0- 

Considering the differences between the Bregman distances and using that the term 
- ||w*HI; cancels out we get 


Dq{n*, u n +\) D q (u*,u n ) 

=\\\vn\\ q E - JIK+illl 

T {J q (pj'n+l ); ^n+1 nfi) E* {Jq {vfi), Vn Vjf) E* ,E 
= - q \\ U n\\ q E ~ JIK+l||| + {Jq ^ («n+l) 7 ««+l) E* ,E ~ {jf^ {u n ), U n ) E* ,E 

- {jf^ E *{u n+ 1) - Jq^ E *{u n ),uf) E *,E 

= ~q* ||^re+l We q* II ^n|| E {A {v n +l V n ), V>*) E*,E 

~^*{Vn +1 V n , f ) F *,F {Vn+1 V n , Aufi) F * F 

= ~ - q {v n+ i - V n , f 5 ) F *,F + {v n +l - V n , f ~ f) F *,F 
< ~ \{Vn+l ~ V n , f S )F*,F + |K+1 “ V n \\ F *S 
= ~ ( d M E{n ) - 5) ||u n+ i - V n \\ F * , 

where we have used again (14.lip in the second equality. 

Let no(6) be an a priori stopping rule satisfying (14. 7b . let {5 k )ke n be a sequence of 
noise levels tending to zero and denote by n k = n 0 (5 k ), n k ME = riM E {8 k ) the stopping 
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indices chosen by the a priori and the monotone error rule, respectively. 

If there exists k 0 such that n k ME > n k for all k > k 0 , then by monotone decay of the 
error up to n k ME we have D q (u*,u n k iE ) < D q {u*,u n k) —» 0 as k —* oo. 

Otherwise there exists a subsequence (/cz)z s n such that for all Z G N we have n k fi E < r k {) 1 
and therefore k q < k *,, so the right hand limit in (14.7(1 together with Lemma 14.51 

n ME n 0 

implies \\u\ —Uk t \\ F -^° 0. On the other hand, by assumption we have rif rE oo, 

n ME Hme 

thus by Theorem 14.61 || u\ — uA\e —> 0 as Z —* oo. Thus a subsequence-subsequence 

n ME 

argument yields the assertion. □ 

Remark 4.9. Convergence in the degenerate case when (ume (5)) has finite 
accumulation points remains an open problem even in Hilbert spaces. 

As regards a relation of the type 

d M E(n ) < \\Au n - f 5 \\ f /2, Vn G N, 

shown in Hilbert spaces (see, e.g., m Th.2, 5)], it is not clear whether such a connection 
could be established in the Banach space framework. 

5. On the requirements for spaces and subspaces 

The three projection methods investigated in this work require different theoretical 
settings as concerns stability and convergence. 

Note that reflexivity of the space E is essential in convergence results for the 
least error method, thus ruling out the case E = 0(0) or E = A4(0), while allowing 
F = 0(0) (thus , e.g., collocation) or F = A4(0) (for modelling impulsive noise). 

The additional restrictions on uniform boundedness (e.g., (12.12)1 ) will be discussed 
in the following section; they are more severe in case of a posteriori choice of n, a fact 
which is already known from the Hilbert space setting. 

The preimage and image space combinations we are interested in are 


E = L P { O), F = Z7(0), p,r6 (1, oo), (5.1) 

E = L P ( O), F = C( O), p G (1, oo), (5.2) 

E = C(Q)* = M(fl) , F = L r (0), p G (1, oo), (5.3) 

E = M( O), F = C( O), (5.4) 


for some smooth open domain C W l . L p spaces with p G (1, oo) are reflexive, smooth 
and g(p)-convex with q(p) = max{2,p}, the duality mappings, which are given by 

( J q( P ? LP O))0) = lkll2? )-P h(®)l P_1 signH(x) p* = 


LP^-LP \-l 


( J q(p) 


tLp^Lp* 

j ApT 


q(p)* 


qjp) 

q(p) - 1 


are invertible with 
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(see, e.g., [HI Section II.2]), and if r > 2, i.e., q(r) = max{2,r} = r, then is 

additionally Gateaux differentiable with Gateaux derivative 

{J%j) Lr )'(^))[ /l ]( x ) = ( r - 1)1 9 (x)\ r ~ 2 h(x). 

Therefore in case (15.1ft all well-definedness, characterization, stability and convergence 
results Lemmas 12.11 13.11 14.11 13.21 14.21 12.41 13.41 14.51 Corollary 13.61 and Theorems 12.51 
14.6112.7113.9114.81 are applicable. In case (15.2ft , we still have all these results except for 
those on stability of the least squares method, Lemma 13.41 unless the projection spaces 
are chosen appropriately (cf. Remark 13.5p . Likewise, in case (15. 3 p all results except 
for those concerning the least error method apply. Finally, in the situation (15.4ft . only 
the results for the general projection method, Lemmas 12.1112.41 and Theorems 12.5112.71 
remain valid. 


6. Applications 

We will now consider applicability of the results derived in the previous sections for 
concrete discretizations, so that the crucial conditions for convergence and stability 
(12.7ft . (12.8ft . (12.14ft . (12.15ft . (13.4ft . (13.7ft . (14.6ft . will become conditions on the smoothing 
properties of the forward operator. These will be interpreted for the case of integral 
equations. For certain test examples we will also provide numerical experiments. 


6.1. On convergence conditions for projection methods 


For applying the results from Sections El El SI in the respective cases, it still remains 
to verify the crucial convergence conditions. However, the convergence conditions (12.81) . 
(12. 14[) . (12. 151) . (13.4ft . (13.7[) (recall the corrsponding sufficient boundedness conditions 
(12.12ft . (12.20ft . (12.21ft . (13.6ft . (13.8ft ) require an appropriate trade-off between stability and 
approximation. Note that these conditions are only needed for the general projection 
and the least squares method, but not for the least error method. 

We will now illustrate these conditions for integral equations with discretization in 
spline spaces. 

Let k, n G N, h = i, 1 < p < oo, 1 < r < oo. We denote by S[ l \(Ih) the 
spline space defined as the set of functions Wh G 67^0,1], which in each subinterval 
R h : [(i — 1 )h,ih\,i = 1,... ,n are polynomials of order < k — 1: Wh\p h G n fc _!. The 
case of potentially discontinuous piecewise polynomial functions Wh will be denoted by 

d:'i(4). 

We recall below several well-known properties of splines. 

1) Approximation property: 

Vw G W l ’ p ( 0,1), 3v h G S^ZiUh) : ||v - v h \\ L v(o^) < C' app h mm(A; ’ i) ||n||^, P (o ) i), 

Vn G C l [ 0,1], 3v h G : ||v - %||c[o,i] < app^^H^llcto,!], 

where D l is the differential operator of order l. 
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Vw/x G S%_l\l h ), \\D l v h \\ L p^i) < C inv n l \\v h \\Lr(o,i) < C im n l \\v h \\ C [o,i]- 

On each subinterval P h we define the local projection P n , using an L 2 (/(^-orthogonal 
basis {(pf\ ..., (j) 1 ^} of n fc _i: 


k 

(PnW)(t) = I 
7 =i 


4> I Ms)w(s) ds (f)\ h {t) t E P h . 


3 =1 ^ 

We consider P n as a mapping P n : 7/(0,1) —> 77 (0,1), with range 7Z(P n ) = E n , 


E n = {v E L p ( 0,1) | Vi = 1,. .., n : v\ ji G . 

By the L 2 (/(() orthogonality of the basis functions, it is easily checked that P* is defined 
in exactly the same manner, but considered as a mapping 77* (0,1) — > 77* (0,1), again 
with range 7 Z(P*) = E n . Obviously I — P* annihilates polynomials of degree lower or 
equal to k — 1 on each P h . 

For checking conditions (12.12p . (I2.20lh (12.211) . (13.61) . (13.81) we can use the following 
lemma which follows from the approximation property of splines. 

Lemma 6.1. Let A E L{E,F), E = 77(0,1), E n = S^(I h ). If F — 77(0,1), 
A*Z n C W l ’ p *( 0,1) or F — C[0,1], A*Z n C C l [ 0,1], then 


sup sup (z n , A(I - P n )w) F * )F 

wGE, ||iu||b=1 z n eZ n , ||z ti ||f*=1 

= sup sup ((/ - P*)A*z n ,w) F * jF < C app h mm{k ’ l) - 

WGE, ||ui||£; = 1 ZnGZn, 11|| J’* =1 


Due to this lemma, for conditions (12.12)1 . (I2.20p . (I2.2ip . (13.6p . (13.8p . we need the 
inequality k > l and the estimate tz n < Cn l . We are able to guarantee the latter estimate 
only for specific operators. 

Lemma 6.2. Let A E L(E,F) with E = 77(0,1), E n = .5^7','*(//,,) and F = 7/(0,1) 
or F = C[0,1]. If for all w n E S[p}i(Ih) wo have ||w n ||E < Ci\\D l Aw n \\ F and 
v n := Aw n E s£Si(4), then 


\w, 


— 


sup 


JUp(0,1) 


WnG S] 


(- 1 ) 


(Ih) 


II Aw. 


< Cn l , C = C x C Vl 


n\\F 


( 6 . 1 ) 


Proof. Let w n E Sjff^(Ih) satisfy the above assumptions. Since v n := Aw n is a spline of 
order k +1 — 1 with increased global smoothness, one can apply the stability property 
of splines to v n : ||ta n ||E < C\\\D l Aw n \\ F < CiC inv n l \\Aw n \\ F . □ 

The conditions of Lemmas 16. 1 1 and 16.21 are satisfied for integral equations of the first 

kind 

(Au)(t) := / K(t, s)u(s) ds — f(t), £e[0,1], 


o 


( 6 . 2 ) 
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whose kernels are Green’s functions for the differential operator D l , l G N under different 
homogeneous boundary conditions, such that the equation D l z = 0 has only the trivial 
solution z — 0. Here K(t,s ) has different forms Ki(t,s) and K 2 (t,s) for regions 
0 < s < t < 1 and 0 < t < s < 1 respectively. Note that a Green’s function of 
D l with boundary conditions 0) = 0, j = 0,1,— 1 is given by the Volterra 
kernel Ki(t,s) — (t — s) 1 ^ 1 /(l — 1)!, K 2 (t,s) = 0. For l = 2 and boundary conditions 
/(0) = /(1) = 0 we have Ki(t, s ) = s(t— 1) = K 2 (s, t), for l = 4 and boundary conditions 
/(0) = /'(0) = /(1) = /'(1) = 0 we have s) = — s 2 (l— t) 2 (s+2st— 3t)/6 = K 2 (s,t). 
Let us formulate the convergence theorem. 

Theorem 6.3. Consider A G L(E, F ) defined by \6.2 1) with E = L p ( 0,1), 1 < p < oo, 
where 

F = 17(0, 1), 1 < r < oo and f G W l ’ r (0, 1) or 
F = £[0,1] and f G £'[0,1] 

is assumed. Let K(t, s ) be a Green’s function of D l with homogeneous boundary 
conditions such that D l z = 0 has only the trivial solution z = 0, let f(t ) satisfy these 
boundary conditions. 

Then the following statements hold: 

(i) Equation H6.2 1) has a unique solution u*. 

(ii) Let E n = 4:! } (4) with k > l. Then the least squares method determines a 
unique approximation u n G E n for all n G N. 

(in) If (12.2p hold the general projection method il.5\) determines a unique 
approximation u n G E n for all n E N. 

Under these assumptions we have for both methods convergence \\u n — u*|| —> 0 
as n —$■ oo in case of exact data 5 = 0. In case of noisy data one has convergence 
\\ u n{ 5 ) ~ «*|| — * 0 as S —* 0, */ n = n(6) is chosen a priori such that n(5) -E oo, 
n(5) l 5 —$■ 0 as 5 —>■ 0 or a posteriori according to the discrepancy principle, where in the 
least squares method b > 1, while in the general projection method assumptions (12.161) 
and b > r + 1 are assumed. 

Proof. The assumptions of Lemmas 16.11 and 16.21 are satisfied, since for any w G E 
we have ||tc||E = ||-D'Au||e and for any w n G E n we have Aw n G E n with increased 
power and global smoothness of the spline. The assertions follow with Lemmas 16.1116.21 
from Theorems 13.7113.91 for the least squares method, and from Theorems 12.5112.71 and 
inequalities (I2.6j) (I2.16j) for the general projection method, respectively. □ 

One can compare the above results to their counterparts in Hilbert spaces (see ED). 
For the general projection method (11.51) . the Hilbert space analog of Theorems 12.51 [2771 
is the following. 

Theorem 6.4. Let A G L(E, F), where E and F are Hilbert spaces. Let f G 7 Z(A) and 
P n : E —>■ E n , Q n : F —>■ F n , Q' n : F —>■ AE n be orthoprojectors, where F n are finite 
dimensional subspaces of F. Let the following conditions (i)-(iii) hold: 

(i) \/u G E : \\P n u — u\\e —> 0 as n —>■ oo, 
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(ii) Vn G N : Af(A*) n F n = {0}, 

(in) 3 T* < ooVz n G F n : t* \\P n A*z n \\ E > \\A*z n \\ E . 

Then equations Au = f and /il.9\ ) have unique solutions n* G E and u n G E n 
respectively. If 5 = 0, then \\u n — u*\\e —> 0 as n —> oo ((i)-(iii) are necessary and 
sufficient conditions of this convergence for arbitrary f G 71(A)). If 5 > 0, then for 
an a priori choice of n = n(8) such that n(8) —* oo, 5 ■ /c*^ —> 0 (8 —* 0) one /ias 

||n n (, 5 ) — —>■ 0 as 5 —* 0. If 5 > 0 and the following additional conditions (iv)-(vi) 

hold 

(iv) Af(A)nE n = {0}, 

(v) 3r < oo \/v n G E n : r\\Q n Av n \\ F > ||Au n || F; 

(vi) 3C < oo Vn G N : n n+ i ||(7 - < C, 

then convergence ||w n ( 5 ) u*\\e —>■ 0 as 5 — > 0 also holds for a choice of n = n{5) by the 
discrepancy principle with b > r. 

Note that in Hilbert spaces, conditions (iii), (v) are automatically fulfilled by 
the least error method (E n = A*F n ) and by the least squares method (F n = 
AE n ) respectively, and that for condition (vi) the inequality ||(/ — < ||(/ — 

P n )(A*A) 2 i\\ l , VI G N is useful. Conditions (iii), (v) here seem to be weaker than the 
corresponding conditions (12.121b (12.20ft . (12.21ft in the Banach space theorems. 

For the least squares method (11.61) . the Hilbert space analog of Theorems 13.7113.91 
is Theorem 16.51 and the analog of Theorem 16.31 is Theorem 16.61 

Theorem 6.5. Let A G L(E, F), where E, F - Hilbert spaces, AT {A) = {0}, / G 71(A), 
P n : E —$■ E n orthoprojector, let \\P n u — n|| —* 0 as n —^ oo for all u G E, and let 

3/gN 3C<oo: (n n +K n+1 )\\(I - P n )(A*A)^\\ l F < C Vn G N. (6.3) 

Then equations Au = f and 11.61) have unique solutions u* G E and u n G E n 
respectively. 7/6 = 0, then \\u n — w*|| —* 0 as n —* oo. If 8 > 0, then ||n n ( 5 ) — w*|| —> 0 as 
6—^0 for an a priori choice of n = n(5) such that n(8) —> oo, 5 ■ K n ($) —* 0 as 8 —» 0 
and also for a choice of n = n(8 ) according to the discrepancy principle with b > 1. 

Theorem 6.6. Let E = F = L 2 (0,1), K(s,t ) in 16.31) be a Green’s function of the 
differential operator 

i 

L t z = ^ bj(t)z b \ bj G C[0,1], b m (t) 0 Vt G (0,1) 
i=o 

with boundary conditions Ej=o Q ij^( 0) + j3ijZ^(l) = 0, (i = 1,...,/) such that 
L[Z = 0 only has the trivial solution z = 0, and let f(t ) satisfy these boundary 
conditions. Then equation 16. 31) has a unique solution u* and the least squares method 
with E n = S/Jf \lh) determines a unique approximation u n G E n \/n,k G N. 
Convergence ||u n ( 5 ) — w*||.e —> 0 as 6 —* 0 holds with an a priori choice of n = n(8) 
such that n(8) —* oo, 6 • n(8) 1 —^0 (6—^0) and also with a choice of n = n(8 ) by the 
discrepancy principle with b > 1. 
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In Theorems 13.71 PUU we needed instead of condition (16.31) the conditions (13.61) . (13. 8 p 
corresponding to the special case l — 1 in (I6.3f) . If 7 Z(A*) = 1Z(A*A)z C W 1 ’ 2 , then 
1Z({A*A)^i) C W 1 ’ 2 and in case E n = K n < Cn l condition (16. 3 p is satisfied for all 

k e N, but (13. 6 p , (13. 8 p require k > l in Theorem 16.31 
We list below several open problems: 

(1) Is it possible to weaken the assumption k > 11 

(2) Is it possible to extend the results of Theorem 16.31 using a more general operator 
Li instead of the operator D l , as in Theorem 16.61 ? 

Concerning (1), computational results for the collocation method indicate that k = l is 
really needed there. Note that (2) can be reduced to the (also open) question, whether 
the following lemma, proved in [2TJ for the case q = r = 2, remains valid for general 
q,r E [1, oo]. 

Lemma 6.7. Let B E L(L q ,L r ), W l f r (0,1) C B(L q ( 0,1)) C W l ' r ( 0,1), where 
<70,1) = {z E 14^(0, l),z^(0) = z<*>( 1) = 0,j = 01}, L q = L q ( 0,1), 
l<g<oo, l<r<oo. Then ||5*n|| L9 « > Ci\\DO l ) v \\ Lr » , Vn G L r *, q* = q/(q — 1), 
r* = rj (r - 1), where D^~% = D l T lV , T* : L r ‘ W l 0 ' r * is the inverse to the differential 
operator D 21 for the boundary conditions z^ f O) = 1) = 0, j — 0,1,..., l — 1. 

In the next section we consider the collocation method as a special case of the 
general projection method, applying Theorem 16.31 to a Volterra integral equation of the 
first kind and estimating r. Note that in H3 a collocation method for integral equations 
of the first kind is considered using kernel functions for basis functions, the number of 
which was determined by the monotone error rule. 

6.2. On the collocation method for a Volterra integral equation 
We consider a Volterra integral equation of the first kind 

(Au)(t) \= f K(t, s)u(s) ds = f(t), t E [0,1] (6.4) 

Jo 

with the operator A E L(L P ( 0,1), C[0,1]), 1 < p < oo. A special case of equation (16.41) 
is the model problem 

(Au)(t) \= f (t — s) l ~ 1 u(s) ds = f(t), t E [0,1]. (6.5) 

Jo 

In the collocation method we find u n E E n = Sjff}^(Ih) such that 

Au n (t i}j ) = f s (t M ), i = 1,..., n, j = l,...,k 

where t it j = (i — 1 + cf)h E [0,1], i = l,...,n, j = 1 are collocation nodes and 
0 < Ci < ... < Ck < 1 are collocation parameters whose choice is essential. 











Regularization by Discretization in Banach Spaces 


27 


In 0, spline collocation is considered in case 5 = 0, E = L°°, F = C, \K(t,t)\ > 0 
(case l — 1 in (16.5p ). Tlieor. 2.4.2 in [5] (page 123) proves that convergence holds if and 
only if 

k 

na _ c j)/ c j < 1 • 

3 =1 

In [7] the case K(t,t) = 0 is considered, where dK g t ,s ^ |t= s ^ 0 (case l = 2 in CI6.5jl ) and 
convergence if c*, — 1 and ]/[*l{(1 ~ c j)/ c j < 1 is proven. Convergence of the collocation 
method for equation (16.5j) in case l > 2 seems to be an open problem. 

In our numerical experiments below we will use the discrepancy principle for the 
choice of a proper number n = n{5) of the subintervals, thus we use the first n such that 
\\Au n — f s \\F < b8. According to Theorem 12.71 we need that b > t + 1, so the value of r 
in (12.16P is needed. For the use of inequality r n < r for all ngffwe need to estimate 


\\Aw n \\ sup te[01] |Aiu n (f)| 

Tn = sup -7- - A -r- = SUp - — --. 

WneE n SUp ZnGZnAlznllFt=1 {Z n ,Aw n ) F * jF Wn&En SUPijI Aw n (Uj)\ 

In the numerical experiments of the next section we solve equation (16.5p with / = 2. We 
use linear splines k — 2 and collocation nodes t iA — (i — 1 )h + ch with c G (0.5,1) and 
ti 2 = ih. It can be shown that r = r(c) depends on c in the form 


r(c) 


4 (y 2 — y + 1) 3 ^ 2 — 4 y 3 + 6 y 2 + 6y — 4 
+ 27y 2 (2c — 1)(1 - c) 


y = c(—2c 3 + c 2 + 1). 


( 6 . 6 ) 


Actually, it is sufficient to consider cubic functions z(t) on the interval [0,1] which 
satisfy 2 ( 0 ) = z(c) = 1, 2 ( 1 ) = —1,2 7 (0) = 2/(c(l — c)(2c — 1)). The last equality is 
the bound on the derivative of the cubic spline Aw n at the points ih under conditions 
Aw n (tig )| < 1 if n —> 00 . The value of r(c) in (16.6p is the maximum of z{t). 


6.3. Numerical example 

We consider equation (16.5p with the exact solutions u*(s) = s r , r G {1/2, 3/2}, where the 
exact right hand side is computed as f{t) = ( Au)(t ). The noisy data were generated by 
the formula fs(ti,j) = f(U,j) + ^i,ji where 6 = 10 ~ m ,m G {2,..., 7} and 9 hJ are random 
numbers with normal distribution, normed after being generated: max^j \9i.j\ = 1. In 
the space setting we used p = 1, i.e., we consider A as an operator from L 1 (0,1) to 
C[0,1]. 

In our numerical experiment we took k — 2 (linear splines) and used collocation 
nodes tn — (i — 1 )h + ch with c G (0.5,1) and t a = ih. Table [1] contains the results 
for c G {0.6, 0.7, 0.8, 0.9}; according to formula (16.6p . the corresponding values of r(c) 
are 5.67, 4.10, 4.22 and 6.51 respectively. For fulfilling the theoretical requirement 
(I2.16P in Theorem 12.71 we actually used 6(c) = 1.01 + r(c) in the discrepancy principle. 
The discrepancy principle gave a number n E of subintervals with corresponding error 
e E = || u nD — u *||. We also found the optimal number n opt of subintervals and the 
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Table 1 . Results for optimal n and for n according to the discrepancy principle 





w* 

(«) = 

s l/2 




(«) = 

s 3/2 


c 

6 

^ opt 

n D 

n 

e D 

r e 

EL opt 

n D 

n 

e-D 

r e 

0.6 

l.E-02 

1 

1 

3.1 

0.325 

1.00 

1 

1 

2.5 

0.502 

1.00 

0.6 

l.E-03 

2 

1 

2.5 

0.289 

1.90 

2 

2 

2.2 

0.180 

1.00 

0.6 

l.E-04 

6 

4 

2.7 

0.079 

1.17 

6 

3 

3.0 

0.092 

2.12 

0.6 

l.E-05 

12 

7 

2.7 

0.040 

1.39 

10 

6 

2.7 

0.032 

2.03 

0.6 

l.E-06 

24 

18 

2.2 

0.012 

1.14 

20 

11 

3.3 

0.011 

2.46 

0.6 

l.E-07 

48 

42 

1.4 

0.004 

1.02 

34 

22 

2.8 

0.003 

1.91 

0.7 

l.E-02 

1 

1 

2.3 

0.336 

1.00 

1 

1 

2.2 

0.516 

1.00 

0.7 

l.E-03 

2 

2 

1.8 

0.145 

1.00 

2 

2 

1.7 

0.169 

1.00 

0.7 

l.E-04 

6 

4 

2.1 

0.065 

1.14 

6 

4 

2.2 

0.054 

1.35 

0.7 

l.E-05 

12 

8 

2.2 

0.025 

1.09 

10 

6 

2.1 

0.022 

1.69 

0.7 

l.E-06 

24 

20 

1.8 

0.008 

1.01 

20 

12 

2.5 

0.006 

1.56 

0.7 

l.E-07 

42 

46 

0.9 

0.003 

1.01 

30 

22 

2.0 

0.002 

1.54 

0.8 

l.E-02 

1 

1 

2.0 

0.358 

1.00 

1 

1 

2.2 

0.534 

1.00 

0.8 

l.E-03 

2 

2 

1.7 

0.148 

1.00 

2 

2 

1.6 

0.164 

1.00 

0.8 

l.E-04 

6 

4 

1.9 

0.063 

1.00 

6 

4 

2.0 

0.050 

1.13 

0.8 

l.E-05 

8 

8 

1.1 

0.023 

1.00 

8 

6 

1.8 

0.019 

1.41 

0.8 

l.E-06 

20 

20 

1.1 

0.008 

1.00 

15 

11 

2.1 

0.006 

1.61 

0.8 

l.E-07 

38 

50 

0.6 

0.003 

1.17 

30 

22 

1.9 

0.002 

1.33 

0.9 

l.E-02 

1 

1 

2.1 

0.444 

1.00 

1 

1 

2.3 

0.600 

1.00 

0.9 

l.E-03 

2 

2 

2.0 

0.175 

1.00 

2 

2 

1.8 

0.169 

1.00 

0.9 

l.E-04 

4 

4 

1.5 

0.075 

1.00 

4 

4 

1.4 

0.059 

1.00 

0.9 

l.E-05 

8 

8 

1.3 

0.025 

1.00 

8 

6 

2.0 

0.019 

1.21 

0.9 

l.E-06 

15 

18 

0.7 

0.009 

1.00 

15 

11 

2.3 

0.006 

1.38 

0.9 

l.E-07 

32 

46 

0.4 

0.004 

1.17 

26 

20 

1.9 

0.002 

1.25 


corresponding error e opt = rnin ne pj \\u n — u*\\e = \\u nopt ~~ w*||e, as well as the best 
coefficient b = b opt for the choice of n = n(S) in the discrepancy principle according to 

bopt ~ //Hf/A 

Table |T] contains our results for the exact solutions n*(s) = s r with r = 1/2 (left) 
and r = 3/2 (right). Columns and r e contain the ratios of the 6-values rb = b(c)/b opt 
and the corresponding errors r e = er>/e op t- The performance of the discrepancy principle 
is determined by the constant b. According to column r&, the lowest values of constants 
b = 6(c), needed by the assumptions of Theorem 12.71 are typically 1.5 to 3 times larger 
than the optimal values b opt . Nevertheless, column r e shows that the errors e n of the 
approximate solutions with choice of the dimension by the discrepancy principle were 
typically not larger than 1 to 1.4 times the optimal errors e opt . Comparison of the errors 
cd for different c -values suggests to use medium c -values 0.7 or 0.8. 
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7. Conclusions and Remarks 

In this paper we have extended some results on regularization by projection in Hilbert 
spaces to a more general Banach space setting. Besides being applicable in case of 
“nice” reflexive Banach spaces like L p with p 6 (l,oo), some of our results also give 
new insights concerning certain cases of nonreflexive Banach spaces like L 00 ,^ 1 ,^, A4 
which are currently of high interest for several applications. Analytical considerations 
and numerical results are provided for a Volterra integral equation in one dimension 
space, using a spline discretization. 

Future work in this context will be devoted to proving convergence rates, 
particularly also in nonreflexive spaces, and to more general applications in higher 
dimension spaces. 
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